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I. Motivation 

The question whether reconstructing the shape of an opaque object by measuring 
the light it reflects is possible was raised in Horn's thesis [HO701 . We Mill 
refer to this as the shape from shading problem. He observed that under certain 
assumptions (which we will discuss in the next section), first order partial 
differential equations describe the relation between the brightness of a small 
patch of an object and the local surface normal • In other words we can determine 
the shape of an object by solving a first order partial differential equation 
(abbreviated in the following by (FO)PDE)» also referred to as the Image 
Irradlance equation. 

The literature about PDE*s is extensive, but the emphasis is on higher order 
PDE*s. As the majority of physical phenomena can be formulated as second order 
PDE's, these equations have been studied the most. 

In this paper we are going to study FOPDE's. Ue try to summarize the various 
known results and describe methods for solving a given FOPDE. At the same time 
Me keep in mind that the equations describe a physical situation and therefore 
their solutions have to make "sense"* A major problem is that the mathematical 
literature deals nearly exclusively with equations and their solutions Mhich are 
continuous and have continuous derivatives in all their variables. But "real" 
objects have edges and there the surface normals are discontinuous. Another 
problem are occluding contours in the pictures as there the partial derivatives 
of the function describing the surface are discontinuous. 

It is intuitively "clear" that if the FOPDE is discontinuous in some of its 
variables, we can expect solutions which have discontinuous derivatives. The 
question arises if we can have such solutions also if the equation itself is 
continuous. Is it possible for example that an object has an edge without the 
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equation reflecting this fact. The answer is yes and we will examine why and how 
this can happen. He will show that in this case initial conditions are going to 
reflect the discontinuity. 

In general, a PDE describes a class of processes and not a a particular 
instance of one of them. Consider as an example the Laplace equation 

Af « 
where A denotes the Laplace operator and f a vectorfield. Then the PDE tells us 
that the field f has no sources and zero curl. But there are a lot of fields 
which fall in this category. Only when we specify some more conditions about f 
can we determine the unique solution of the equation, 

Ue will study what Kind of constraints are necessary to pin down a unique 
solution of a given image irradiance equation. An attempt will be made to find 
constraints which are accessible* i.e., which can be measured. 



n. The shape from shading problem revisited 

There are basically three components to this problem which we have to 
understand. They are the lightsource, the object and the viewer. 

The exposure of film in a camera (for fixed shutter speed) is proportional to 
image irradiance, the flux per unit area falling on the image plane* Similarly, 
grey levels measured in a electronic imaging device are quantised measurements of 
image irradiance. 1 1 can be shown that image irradiance in turn Is proportional 
to scene radiance, the flux emitted by the object per unit projected surface area 
per unit solid angle [H0S78] . The factor of proportionality depends on to 
details of the optical system including the effective f-number. 
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Scene radiance depends on the 

1) surface material and its microstructure, 

2) the distribution of light source, and, 

3) the orientation of the surface. 

Consider a viewer-oriented coordinate system with the viewer located far above 
the surface on the z-axis. If the objects imaged are small compared to their 
distance from the viewer, one can approximate the imaging situation by an 
orthographic projection, 

x' « x(f/z0) y' « y{f/z0) 

where (x\yM are the coordinates of the image of a point (x,y,2) made with a 
system of focal length f, when the viewer is at distance Zg above the origin. Ue 
assume that (x^ -f y + z^) « zg^. 

The orientation of a patch of the surface can be specified by given its 
gradient {p,q), where p and q are the first order partial derivatives of z with 
respect to x and y. For a particular surface material and a particular 
distribution of light sources, scene radiance will depend only on surface 
gradient. This function, R(p,q), (or a contour representation in gradient 
space), is called the reflectance map* 

If L(x,y) in the scene radiance calculated form the observed image irradianc© 
at the point (x',yM in the image then 

R{p,q) = L(x,y) (2,2) 

where (p,q) is the gradient at the corresponding point on the object being 
imaged* This equation is called the imge irradiance equation. It is clearly a 
first order partial differential equation since it involves only the partial 
derivatives p and q and the coordinates x and y, 

A word of caution: we are not dealing with several issues like mutual 
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I luminal ion, shadows and specularity. 



Ill, Basics 

For simplicity of exposition we will only deal with partial differential 

equations involving a function z of two variables x and y. It is more or less 

"obvious" how to generalize the results to functions of n variables* Ue will 

denote z and z,, ~ the partial derivatives of z with respect to x and y - by p 
X y 

and q respectively. Then the relation 

F(x»y,z,p,q) « (3-1) 

is called a first order partial differential equation. A function z(x,y) Is 
called a solution of (3.1) if in some region of the x-y plane the function and 
its derivatives satisfy the equation identically in x and y. Such a function is 
also called an integral surface. 

Uhen solving a partial differential equation we want to find the "general" 
solution which is a whole "set" of solutions. By imposing some additional 
constraints we can find the particular solution in which we are interested* Such 
constraints can be for example boundary conditions or initial values* In a later 
section we will state precisely what we mean by a "general" solution and what 
kind of constraints are necessary to pin down the desired solution* 

The relation {3.1) is a linear PDE if it is linear in z, p and q with 
coefficients depending only on x and y and (3.1) is quasi-linear if it is linear 
in p and q with coefficients depending on x, y and z. 

Unless otherwise stated we will assume that F, z and all relevant derivatives 
exist and are continuous. 
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IV. The quasi-linear first order PDE 

Ue will first consider this special POE as its geometric interpretation is 
rather clear and so the relevant method for solving it can be eKplained and 
understood easily. In this case the relation (3.1) can be rewritten as 

a(x.y,z)p + b(x,y,z)q » c(x,y,z) (4.1) 

To rule out trivial cases we will further assume that 

a^ + b^ X 8 
We will try to find solutions to (4.1) given implicitly by 

G(x,y.z) = (4.2) 

Differentiating (4.2) with respect to x and y gives us 



or equivalent I y 



^x + G^z^ = and Gy + G^Zy = (4.3) 



^x = - ^x^^z ^"^ ^y = - Gy/G^ (4.3') 



re- 



using (4.3') in (4.1) we get 

a(x,y,z)G^(x,y,z) + b(x,y, z)Gy (x,y, z) + c(x,y,z)G2(x,y,z) - (4.4) 

Note that in general (4.1) is a nonlinear PDE for the function z(x,y) whereas 
(4.4) is a linear PDE for G{x,y,z). Ue can interpret the coefficients a(x,y,z), 
b(x,y,z), c(x,y,z) in (4.4) as the components of a vectorfield 
W - 1f(x,y,z) - [a(x,y,z),b(x,y,z),c(x.y,z)]. 

Then we can rewrite (4.4) as 

<Sr,VG> = (4.5) 

where VG denotes the gradient of G and < , > the inner product of two vectors. 

Ue know that at each point VG is perpendicular to the surface defined by 
G(x,y,z) and the equation (4.5) tells us that 81 is perpendicular to VG. Thus W 
has to lie in the tangent plane of the integral surface defined by G(x,y,z). 

Let us introduce the notion of a fieldline of a vectorfield. By a fieldline 
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we understand a curve whose tangent at every point has the direction of the 

fieldvector there. Then an integral surface can be buiit up from ft el dimes 

(called characteristics in this context) of the vectorfield t(. To reiterate the 

previous statements: The tangent at each point of a characteristic has the same 

direction there as the vector 8f and therefore by virtue of (4*5) the same 

direction as the tangent plane of the integral surface G{x,y»z). This does not 

mean that each quasi-linear PDE has a single solution. Such a ROE only 

constrains the possible orientations of the tangent planes at each point to a 

one-parameter manifold. As (4.1) is linear in p and q all feasible tangent 

planes at every point of an integral surface intersect In a line which is called 

the flonge axis. Thus finding a solution to (4.1) means finding a surface which 

at each point has the direction of the llonge axis (the direction of the vector 

If) as its tangent direction. 

Let us now describe a method of finding the characteristic curves, which can 

be written as functions of one parameter x«x(s)t y==^y(3) and z«z(sK Then 

g(s) « [x(s) ,y(s) ,z(s)] (where * denotes differentiation with respect to s) has the 

same direction as W and therefore the outer product of J{s) and tt has to be 

zero. 

bz - cy « 

ex - az « (4«B) 

ay - bx « 

The relation (4.G) is normally written as 

dx : dy : dz « a s b s c (4.7) 

The solutions of the equations (4.7) comprise a two-parameter family of curves 
in space (the characteristics). He know that only a one-parameter subset of them 
generate the solutions of the PDE . To find this subset we introduce an 
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arbitrary function between the two free parameters we get solving (4.7), So the 
general solution of (4.1) contains an arbitrary function of one parameter. 

Now we are able to summarize all the previous stated results as follows: Each 
surface which is produced by a one-parameter family of characteristics is an 
integral surface. Conversely each integral surface is generated in such a 
fashion. 

The first statement should be clear by now (otherwise this is not a 
"comprehensive" guide to first order PDE's). To understand the second, remark 
the fol lowing. 

On each integral surface z = z(x,y) the equations 



dx dy 

— = a(x,y,z) — = b(x,y,z) 

ds ds 

dfefine a one-parameter family of curves: x = x(s) , y - 9(9) .2 = z(x(9) .y(s) ) . 
Note that on such a curve 

dz 

— = c(x,y,z) 

ds 



as 



dz dz dx dz dy 
ds dx ds 3y ds 



example ; 

F(x»yfZ,P,q) « xp + yq - z « 
Then the equations for the characteristics (4.7) are 

dx 5 dy : dz « x : y :z 
and have as their solution the two-paratneter curves in space 



PAGE 10 

y - C|X 



z = C2X 



Now we introduce an arbitrary function u between the two constants? wCCj) « G2 
to find a one~parameter subset of (*) 

z y 

. « Co « wCCj) = w(~) 

XX 

solution of the PDE : z = w{y/x)x 

or in parameter form t y » Cix and z « wtC^lx, 



V. Method of characteristics for general first order PDE's 

Ue want to apply similar methods as developed in section IV to the general 

first order PDE 

F(x,y,z,p,q) «= (5»1) 

To exclude trivial cases we will assume that 

F^2 + F^2 ;^ 
P ^ 

Our goal is to transform the problem of finding a solution to (5.1) to the 
problem of integrating a set of ordinary differential equations. Again 
geometrical reasoning will help us find these equations. 

Let us fix a point P with coordinates (x,y,z) on an integral surface. Then 
the quantities p and q are constrained by (5.1) to a one-parameter family of 
curves. [in other words: Once x, y and z are fixed, (5*1) is an equation for p 
and q. To write this equation in parameter form we only need one parameter,! As 
p and q determine the direction of the tangent plane at P, we have just 
established the fact that (5.1) constraints the feasible tangent planes to a one- 
parameter family. The envelope of the tangent planes is a conical surface and is 
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called rionge cone. This surface can have several sheets. Then "the 
considerations here refer merely to a suitable small range of tangent planes, 
e.g., a portion of a sheet of the cone where q can be expressed as a single- 
valued different! able function of p [C0HI62K" Each generator of this cone 
represents a possible direction of the tangent plane at P and is called a 
characteristic direction. Thus the integral surface has to "fit" into the field 
of Monge cones. 

Recall noM that in the quasi-linear case the Monge cone degenerated to the 
Monge axis, i.e. at every point the direction of the tangent plane Mas fixed. In 
that case we proceeded by finding characteristic curves which at every point had 
as their tangent direction the direction of the Monge axis there. He concluded 
that the integral surface is swept out by the characteristic curves. Actually we 
can do the same thing in the case of a general PDE, but we have to be a little 
more careful this time. First we find the curves which at every point have as 
their tangent direction the characteristic direction. Let such a curve (called 
focal curve) be given by x(s), y(s) and zls). Remember that we are looking for 
curves which sweep out the integral surface z{x,y). In other words we want the 
functions x{s), y(s), z{s), p(s) and q(s) to satisfy the PDE (B.l). The focal 
curves only determine x(s), y(s) and z{s) and (5.1) gives us only a relation 
between p and q. So we are one equation short in order to determine p and q. Ue 
will obtain this equation by forcing the focal curves to lie on the integral 
surface. The focal curves, which also satisfy this last condition are called 
charactei-istic curves. Again the characteristic curves sweep out the integral 
surface. 

Actually the problem we are concerned with is to find the integral surface. 
So we have to go the "opposite" way from what was described in the preceding 
paragraphs. Ue will first find a set of equations, called the characteristic 
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equations, A subset of the solutions of this set are the characteristic curves, 
from which the integral surface can be built up. 

In thq following paragraphs we are going to develop the technical "machinery*' 
to find an integral surface of (5,1). 

Our first task is to find the equation of the flonge cone. So let us fix a 
point (x,y,z). Then we can write p and q - which satisfy (5.1) - as functions of 
a parameter u and all feasible tangent planes at (x,y,z) can be expressed as 

(Z-z) « (X-x)p{u) + {Y-y)q(u) {5-2) 

The envelope of the planes defined by (5,2) defines a conical surface with 
vertex at (x,y,z), the Monge cone, [aside: a conical surface is produced by 
moving a straight line which is fixed at one point along a curve], I4e get the 
equation of the Monge cone by el ifninating u from (5.2) and (5.3) which is 
obtained by di f ferent iating (5,2) with respect to u, 

(X-x)dp (Y-y)dq 

:= + (5.3) 

du du 

Differentiating the PDE (5,1) with respect to the parameter u we obtain 

dp dq 
= Fp- + Fq- (5.4) 

du du 
Assuming that neither dp and dq nor F and F vanish identically we get from 
(5,2), (5.3) and (5,4) that 

X~x Y-y Z-z 



(5.5) 



F^ F^ pF^ + qF„ 
p q »" p ^ q 



By substituting all possible values for p and q (i.e, all values for p and q 
which satisfy (5,1) ) we obtain all generators of the flonge cone at the point 
(x,y, z). The generators of the llonge cone at the different points of the 
integral surface define the tangent direction of the focal curves. Therefore the 
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focal curves have to satisfy the following differential equations. 



dx dy dz 

ds ds ds 

Let z = z(x,y) be an integral surface on which we also know p and q. Then the 
equations 

dx dy 

ds ds 
define a one-parameter family of curves. 
On these curves 



dz dx dy 

X y 
ds ds ds 



Zx- + Zy" (5.8) 



^i**% holds and using (5,7) in (5,8) we obtain 



dz 

" = pFp + qFq 
ds 



tasides The above condition is called strip condition, "It states that the 
functions x(5), y(s), z{s), p(s), q(3) not only define a space curve, but 
simultaneously a plane tangent to it at every point, A configuration consisting 
of a curve and a family of tangent planes to this curve Is called a strip 
[C0HIG2],"] 

So (5.8) states that the curves defined by (5,7) are focal curves. Now ue 
also require that a focal curve is embedded on an integral surface: ["By 
embedding we mean that in the neighborhood of the projection of a focal curve on 
the x-y plane z is a single-valued, twice continuous di f ferent iable function of x 
and y tCOHIBZl,"] If we differentiate the PDE (5.1) with respect to x and y Me 
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get 






(5.3) 



Using (5.7) and the fact that p = q^^ we get 



y -^x 

dp dx dy 

-- = Px" + Py" " Px^p + ^x^q 
ds ds ds 



(5.18) 



-- = -^x" + %-- = Py^ + Vq 



dq dx dy 
ds ds ds 
Using (5.9) in (5»10) we get 

dp 

ds 
dq 
ds 



+ F^p + F^ » 



-~ + F^q + Fy « 



(B.ll) 



Ue can now summarize the previous results as followss If a focal curve is 

embedded on an integral surface then along the curve the coordinates x.y.z and 

the quantities p and q satisfy the following five ordinary differential 

equations: 

dx dy dz 

-- = Fp - = F^ - = pFp + qFq 

ds ds ds 

(5.12) 

dp dq 

~- = -{pF^ + F^) ~- - -(qF^ + Fy) 

ds ds 

Let us now consider the system (5.12) by itself, i*e. disregarding that we 
obtained it with a given integral surface in mind. Note first that F(K,y,z»p,q) 
is constant along each solution of the system (5.12) as 
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^^ dp dq dz dx dy 

- . Fp- + Fq- 4- F^- + F^- + Fy- = 
ds ds ds ds ds ds 

=• - Fp<PF^z - F,) - Fq^qF^ + Fy) . F^CpFp . qF^) . F/^ . F^F^ - 

Thus F{x,y,z,p,q) = constant is a solution of (5,12). The system of equations 
(5.12) defines a four-parameter family of solutions. By imposing the additional 
constraint that the solutions of (5.12) also satisfy the PDE (5.1) ue obtain a 
three-parameter subset of the solutions, the characteristic strip. "A space 
curve x(s), y(s), z(s) bearing such a strip is called characteristic curve 
tC0HIB2]." Ue have already established the fact that a one-parameter subset of 
the three-parameter family of curves sweeps out the integral surface. 

As characteristics depend on the solution, their range of influence cannot be 
determined in advance. 

In the next section we will discuss the notion of a complete integral and then 
we will show how to choose the appropriate one-parameter subset. 

So the problem of finding a solution to (5.1) is equivalent to integrating the 
system of five ordinary differential equations (5.12) which are also called the 
characteristic equations. 
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VI. General solution and complete integral 

In the previous section we saw that each solution of a general first order PDE 
is swept out by a one-parameter family of curves. Thus the equation of an 
integral surface can be written as a function of the coordinates x and y and of 
an arbitrary function of one variable; such an equation is called the general 
solut ion. 
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Let us nou assume for a moment that we have a solution 2 ^ ^(K,y,a,b) of the 
PDE which depends on two parameters* Then we say <^(><,y,a,b) Is a complete 
Integral if 

° " ♦xa^yb •" ♦xb^ya 

is not equal to zero. This condition assures that ^ really depends on tuo 
parameter, i.e. that there is no a « g(a,b) such that ^(x,y,a,b) « ^{x,y,cx)» 

From the two-parameter family of planes defined by ^(x,y,a,b) we can choose a 
one-parameter subset by introducing an arbitrary function which relates a and b, 
e.g. set b = w(a). Note that the family ♦(x.y^a.wla) ) is again a solution of 
the PDE . The following idea makes the concept of a complete integral 
significant: The envelope of the family ♦(x^y.a, w(a)) is again a solution of 
the PDE since at each point it touches a member of the family ^(x,y,a,w(a) ) i*e. 
a solution. Or conversely each point of the envelope is a solution of the PDE . 
Ue obtain the equation of the envelope by eliminating the parameter a from the 
two equations? 

z = ^(x,y,a,w(a)) 
*g(x,y.a,w(a)) + ♦,^(x,y,a,w(a) )wMa) «0 

Eliminating the parameter a from (B.l) yields an expression involving an 
arbitrary function w of one variable, which is a solution to the PDE and 
therefore we have found the general solution. Ue will now exhibit this fact 
analytically. By differentiating (G.l) with respect to x ar\6 y we get 

z^ « ♦^ -f (^3 + ♦j^wMa))a 

' ' ^ *" (6.2) 

Zy = *y + (♦3 + V*(a))ay 

Ue know that ^{x,y,a,w(a) ) is a solution for any choice of the parameter a. 
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Using (B.l) (i.e. ^^ + *^^u' ia) = 0) in (G.2) establishes the fact that for all k 

and y the values of z, z^ and z are the satne as those of ^, ^ and * . ' 

y X y 

So if we know the complete integral of a given PDE we can obtain the general 
solution by just using the process of differentiation and elimination of 
parameters. (This later process can in practice be tedious or impossible, but is 
often not necessary, as by plugging in all different values for a, all solutions 
of the PDE are obtained.) The only problem with the above described method is 
that there is no easy way to find a complete integral. In the next section we 
wilt show that with the help of the characteristic equations we can find a 
complete integral. 

The general solution does not comprise all solutions of a PDE . The envelope 
of the complete integral, the so called singular integral, is again a solution 
which cannot be obtained from the general solution. The equation of the singular 
integral, which does not contain any arbitrary elements, is found by eliminating 
the parameters a and b from the equations 

z = 0(x,y,a,b) 

*^,(x,y,a,b) = 9 

Ue have assumed all along that all eliminations are possible and that during the 

course of this process we obtain functions with continuous derivatives. 

Actually we do not have to know the complete integral in order to find the 

singular solution. Note only that, for a complete integral, F(K,y,^,* ,^ ) 

K y 

vanishes identically for all choices of the parameters a and b. I f we now 
differentiate the PDE with respect to a and b we get 



PAGE 18 

(G.4) 

''♦♦b -^ f'p^xb + Pq*yb " 

As <^ is a complete integral, D = ♦xa^ub " *xb*ua '^ "^* equal to zero* 
Furthermore ^^ and ^j^ are zero (equations (G,3) ) and therefore we get the 
equation of the singular integral from (G.4) by eliminating p and q from 

F^ = F„ « F « (G-5) 

p q 

7 7 
[aside:we did not assume in this case that F + f ;< as we did when obtaining 

the characteristic equation,] 

If the ROE does not contain the function z(x,y) explicitly then there exist no 

singular solution as in this case the complete integral is of the form 

z » ^(x,y,a) + b 

and the condition ^i. « can not be fulfilled. 



VIL Method for finding the complete integral 

In the previous sections we have shown two methods for finding the solutions 
to a given PDE • Now we will show how, with the help of the characteristic 
equations, we can find a complete integral and this will also then be a way to 
find a one-parameter subset from the four-parameter family of solutions of the 
characteristic equations. 

First we have to discuss a special form of PDE called Pfaff's equation. 

f(x,y,z)dx + g(x,y,z)dy -f h(x,y,z)dz « (7.1) 

In the case when h s and f and g depend only on x and y (7,1) degenerates to 
an ordinary differential equation which is called an "exact" differential 
equation. 
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f(x,y)dx + g(K,y)dy = (7,2) 

The equation (7.2) is cailed "total" if f and g satisfy the integr ability 
cond i t i on 

^y<x.y) - gK<x»y^ (7^3) 

In the case of a total differential equation it is easy to find a solution to 

(7.2) • On each simply connected region we can find a function H(x,y) such that 

3H m 

— « f(x,y) and — « g{x,y) (7.4) 

3x 3y 

then 

dH = f(x,y)dx + g(x,y)dy 
and the equation dH « is equivalent to (7.2). 

Thus H(x,y) =r constant is a solution to (7.2) and the function H can be found 
by integrating (7.4). 

In the case that (7.3) is not satisfied by the given equation (7.2) one can 
always introduce an "integration" factor |i(x,y) such that the equation 

Mfdx -^ Mgdy » (7.5) 

is total, i.e. that (^f)^ « (^g)^. Or equivalently |i(x,y) has to be a solution 
of the following PDE which can be solved with the method of characteristics. 

Mfy - g^) + ^yf - M^g = 
Now let us return to equation (7.1) which is again easy to solve If its left 
hand side is a total differential of a function H(x,y,2) i.e. if 

8H m 8H 

f = >. g = -- h « ~~ (7.8) 

5x 8y dz 

Necessary for (7,8) to hold is that 

3f ag 3g 3h 3h 3f 

ay 3x 8z 3y 3x 3z 

In a simply connected area (7.7) is also sufficient for the existence of a 
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function H(x,y,z) which satisfies (7,B) and can be. calculated as 

(x.y.z) 
H(x,y,z) = /(fdx + gdy + hdz) + C 

where {x0.y0t20^ is a fixed point. Clearly H(x,y,z) « constant is a solution to 

In the case when (?•?) is not satisfied we again want to find an "integration" 
factor M(xty.2>^ Buch that the expression iifdx + iigdy -f iihdz is a total 
differential of a function. In comparison to Pfaff's equation in two variables 
it is not always possible to find such a factor. 

Necessary for m to exist is that the following equation holds: 

f(g^ - hy) + g(h^ - f^) 4 h(fy - g^) « (7.8) 

It can also be shown (simple, but tedious) that in a simply connected region 
(7.8) is sufficient for (7.1) to possess a one-parameter family of solutions 
H{x,y,z) « constant. He will show now how to construct such a function H(x,y;z), 

First let us consider the "abbreviated" equation 

f(x,y,z)dx + g{x,y,z)dy « (7.9) 

This is a Pfaff's equation in the two variables x and y with z as a parameter. 
Thus we can always (eventually with the help of an integrating factor X(x,y,z) ) 
find a solution to (7.9): 

♦ (x,y) « u(x,y,z) - C (7.10) 

Note that 

du du 

Xf = — and Xg « — (7,11) 

8x 8y 

Now we define a function S depending on the three variables x,y and z by 
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3u 
SCx.y.z) » Xh - — (7 12) 

If we express - with the help of (7.18) - y as a function of x, u and z, we can 
redefine S as a function of x, u and z, i.e. 



Kx.u.z) - S(x,y,z) (7.13) 

Ue will prove now that T is actually independent of x. Then we can find 

H(x,y,z) by solving another Pfaff's equation in the variables u and z. To prove 

that BJ/dx = we use equation (7.11) and (7.12) and obtain: 

a 3 . 

— (Xh - S) - u^^ = — (Xf) 
8x dz 

3 3 

-(Xh - S) = Uy^ = -(Xg) (7.14) 



d\J dz 

a 3 

— (Xg) - u^y = — (Xf) 

3x 3y 

or (equation (7.14) written out in full) 

Sx = ^K - ^h + ^^\ - ^z' «7.15) 

- Sy = gX^ - hXy + X(g2 - hy) (7.18) 

= fXy - gX^ + X(fy - g^) (7.17) 

Multiplying (7.15) by g. (7.1G) by f and (7.17) by h and then adding up the three 
equations using condition (7.8) gives us 

QSx - ^Sy - e (7.18) 

Differentiating (7.13) with respect to x and y gives us 



S « T + T u 

^X X UK 



% " ^u^ 
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(7.19) 



If we combine now (7,11), (7.18) and (7.19) we obtain: 

= gS^ - fSy = gT^ + gT^u^ - fT^Uy « 
- gT^ -f XfgT^ - XfgT^^ - gT^ 

As g 9i! we can conclude that T^^ =» 0, Thus we can rewrite (7.13) as 

S(x,y,z) « T(u,2) 
The equation (7.1), after being multiplied by X and with the expressions 
(7.11) and (7.12) used, reads now as follows: 

X(fdx + gdy + hdz) = u^dx + u dy + (u^ -f T)dz « 
or equivalently 

du + T(u.z)dz « (7.20) 

This is again a Pfaff's equation in two variables which we know how to solve. 
Its solution is ^(u,z) = C. Thus the solution to (7.1) is 

H(x,y,z) = ^(u(x,y,z) ,2) « C 
which is one-parameter manifold. 

Finally we are ready to describe a method for finding a complete integral of a 
general first order PDE F(x,y,z,p,q) » 0« 

The basic idea is that we can interpret the total differential of a solution 
2(x,y) of the PDE 

dz = pdx + qdy (7.21) 

as Pfaff's equation in the variables x, y and z. To really do so we still have to 
express p and q as functions of x, y and z. Now assume that we can find two 
functions f and g such that if we set 



/^•, 



r^s 
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p » f(x,y,z,a) and q «= g{K,y,z.a) (7.22) 

(where a i s an arbitrary constant) the PDE and condition (7,8) (with h m ~1) 

fg^ - gf^ - fy + g^ = 8 (7.23) 

is satisfied. Then the solution to (7.9) is a one-parameter manifold, but as we 
have already built in a parameter a into the equation (7.9) the solution contains 
two parameters and is the complete integral. So we have to solve the problem of 
how to find such functions f and g. He need two equations to do so. Let us 
assume that somehow a function G(x,y,z,p,q) exists such that p and q (or 
equivalent I y f and g) can be expressed from the two equations 

F(x,y,z,p,q) « 8 

(7.24) 

G{x.y,z,p,q) » a 

(aside: thus F^G^ - F^G #0). 

Now we want to assure that f and g obtained in such a fashion satisfy (7.23) 
identically in the three variables x, y and z. Differentiating (7.24) with 
respect to x, y and z gives us: 

^ ^ Py^P ^ ^y^ = ^ S ^ PyS ^ ^y^q = ^ ^^-^S) 

F^ + p/p + q/q = 8 G^ + p^Gp + q^Gq + 8 

After expressing p^, q^, p^ and q^ from (7.25) and plugging this expression 
into (7.23) we obtain the linear first order PDE for the function G 

•"pCx -^.f^qGy + (pFp + qFq)G^ - (F^ + pF^)Gp - (Fy + qF^JG^ - 8 (7.2G) 

We can solve (7.2G) with the method of characteristics. The appropriate 
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system of characteristic equations is the same as the one for F(x,y,2,p,qJ « 

dx:dy:dz:dp:dq « Fp-Fq* ^pl^p ^ q^q^'-'pFz + F^^^^-^pF^ "^ "^y^ (7,27) 

But we need now only one integral of (7,27) - which is independent of F and 
contains at least one of the variables p and q. Such an integral is our desired 
function G, There will always be such an integral as the solution of (7,27) 
comprise a four-parameter family: 

Vj (x.y,z,p,q) = Cj i « 1,2,3,4 

The Vj are independent and at least one of them must contain either p or q. 

The just described method is due to Lagrange and Charpit. It has the 
advantage over the method of characteristics as described in section V in that we 
only need to find a single integral of (7/27) instead of finding the four- 
parameter family of curves. 



VIIL Initial-va lue problem for linear and quasi-linear PDE's 

Now that we know how to find the general solution of a given first order PDE 
we will attack the problem to determine the constraints with which a particular 
solution can be found* 

He will consider the quasi -linear PDE 

a(x,y,z)z^ + b(x,y,z)2,. « c(x.y,z) (8.1) 

'^ y 

Ue now want to find the integral surface zCx^y) which passes through a given 
curve C in space (in the literature referred to as Cauchy' s problem). Clearly 
the following questions have to be answered: 



J^^\ 
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1) Uhat conditions on C are necessary such that this problem Is solvable. 

2) When is such a solution unique. 

Let C be given by continuous di f ferent iable functions of a parameter t; x(t), 
y(t), z(t). Furthermore we will assume that the projection of C on the x-y plane 
(later referred to as Cg) does not contain double points ~ (without this 
constraint we obtain surfaces with self intersections, i.e. z is not everywhere a 
single-valued function of x and y, which implies that along the line of 
intersection p and q are discontinuous) - and that x^^ + y^^ ^ g^ ^^^ ^^ 
construct a solution of the PDE which contains C we lay through each point of C a 
characteristic curve whose equations depend now on two parameters: 

X = x(s,t) y = y(s,t) z « z(s,t) (8.2) 

Note that the functions x, y, z are still continuous di f ferent iable. To get the 
equation of the integral surface we have to eliminate the parameters s and t from 
the equations (8.2). i.e. we have to express s and t in terms of x and y. A 
sufficient condition to do so is that the functional determinant A as specified 
in (S.3) does not vanish along the curve C, 

^ == ^s^t ~ ^s^t t8,3) 

tasides using the characteristic equations we can rewrite (8.3) as 
A = ay^ ~ bx^] 

Thus if A i"^ we can express z as a function of x and y and it Is assured that C 
lies on the surface. The solution is also unique which follows from the 
fol lowing lemma: 

Each characteristic curve which has one point in common with ar\ integral 
surface, lies completely on this surface. 

The proof of this lemma is the uniqueness theorem for solutions of ordinary 
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differential equations. 

The determinant A can be interpreted as the outer product of the two vectors 



'^s^ 



^1 =1 1 and ^2 



C) 



which are the projections of the tangent and the characteristic direction on the 
x-y plane. In the special case when A vanishes along C these two directions 
coincide and we can deduce that C has one of the three properties listed below: 

1) C is a characteristic curve, 

2) C is the envelope of the characteristics, (called edge of regression) 

3) C0 is the envelope of the projections of the characteristics on the x-y 
plane. 

Let us first discuss case 1). From A ~ we get 

^t yt 

(8-4) 

a b 
If we use x(t) and yCt) (from the equation for C) in z(x,y) then the following 

equation has to hold along C: 

dz dx dy 
dt dt dt 

Or equivalent ly we can say that C satisfies the characteristic equations and Is 
therefore a characteristic curve. Obviously the solution of the PDE is not 
unique in this case. Actually in the case when C is a characteristic curve there 
exist infinitely many surfaces through C which satisfy the PDE • To see that 
just choose another curve C along which A vanishes and which has a point P in 
common with C. Now to construct the solutions through C^ one lays the 
characteristic through every point of C\ in particular also through P, (ue. the 
characteristic curve through P is C), Thus an integral surface through C 



/****^- 



r^' 
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contains C. In such a way infinitely many integral surface can be constructed 
which contain C. They meet along the characteristic curve and we can say that C 
is a branch curve. 

One assumption we had made should be stressed here again: we were looking for 
solutions of the PDE which in the neighborhood of C are continuous and are 
continuous di f ferent iable* It might be possible to find a solution z through C. 
along which A vanishes, without C being characteristic. These are the cases 2 
or 3 as mentioned above. But then the derivatives of z are not continuous on C» 
Let us illustrate this problem with an example. 

example 

F(x,y,z,p,q) = 3(z - y)^p - q « 
characteristic equations^ 

dx 

" = 3(z ~ y)2 

ds 

ds 

dz 

— « 

ds 

solution of (*) with initial values xg, y^, zo: 

X « (Z0 ~ yg + s)3 + xg ~ (Z0 - y0)3 

y = - s + yg i^) 

He want the solutions (**) pass through C given by: 

x«0 y=t z«t 
Note that C is not a characteristic. 
So we set the initial values xg, y^, Zg (i.e. x,y,z for s = 0) as 
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X0 = y0 = t 20 - t 
Uith these initial values (**) becomes 

X = s3 
y = ~s + t 
z « t 

and the determinant A is in this case 

2 
A « x^y^ - x^y^ « Ss^ 

Thus along the curve C ( i .e. s = 0) A « 

But there is a solution of the PDE which passes through C: 

2 « x^^^ -f y 

Note that p « l/Sx''^ does not exist along C (as x = there). 

Now we will explain the previous example. To deduce from A « that C is a 
characteristic curve we used the relation; 

dz dx dy 

dt dt dt 

But (8.5) is based on the following lemma in analysiss 

Let G be a region in R^, f:G -^ R. If the partial derivatives at c € G exist 
and are continuous in a neighborhood of c then f is di f ferentiable at c. 

This lemma is not satisfied if C is an edge of regression or Cg is the envelope 
of the projection of the characteristic curves on the x-y planes (cases 2 and 3 
in the above list). 

In the case of a linear PDE we can make some more statements about the 
solution if A vanishes along C, He will show that in this case the integral 



Z**^- 



/~N, 
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surfaces are cylindrical surfaces perpendicular to the x-y plane, i.e. that the 
solution is independent of z. The PDE is 

a(x,y)p + b<x,y)q = c{x,y) 
Recall that A is defined as 

A = XsWt - Xfys 

Note that if A^ (i.e. the partial derivative of A with respect to s) and A 
vanish along C. then A vanishes everywhere. (proof: existence and uniqueness 
theorem for ordinary differential equations.) 
Using the characteristic equations: 

Xg = a 

(*) 

yg ==b 

we obtain for A 

s 

Ag = a^y^ + ay^^ - b^x^ - bx^^ = 
= agy^ + ab^ - bgX^ - a^b 
Differentiating a and b with respect to s and t and using relations (*) we get 

^s = ^x^ + V 



^t = ^x'^t + Vt 
''s - ^3 + byb 

''t = ^><t + Vt 



and then 



A3 = (a^ + by) A 



Ue want to express x as a function of y and z, i.e. x - f(x,y) and so we assume 
that y^z^ - Zgy^ ^ 8 along C. Then we will proceed showing that f - 8, which 
Mill prove that the integral surface z is a cylindric surface. 
Differentiating x with respect to 3 and t we obtain 

^s " ^ys + ^z^s 
^t " Vt ^ ^z^t 
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then 



from Uhich it follows 



A - f^fZgUt - Z^%) 



f, -0 



IX, Initial- value problem for general first order PDE's 

Ue have seen that the problem of finding a solution to a general first order 

PDE is equivalent to solving the system of characteristic equations* Again we 

are posing the question about what kind of constraints determine a solution 

uniquely. Clearly we need more than in the quasi -linear case, as now the the 

solutions to the characteristic equations form a three-parameter family of 

curves. So let C be a curve given by xCt), y(t), z(t) such that neither C nor 

its projection on the x-y plane have double points. Furthermore we have to 

specify p(t) and q(t) along C such that the condition 

dz dx dy 

— = p— -f q— 

dt dt dt 

and the PDE (5.1) (i.e- F = 0) holds identically in t. Ue say that the function 
K(t), y(t), z(t), p(t), q(t) define an initial integral strip denoted by Cj. 
From now on the procedure is very similar to the one for solving the initial 
value problem for a quasi-linear PDE . So through every element of Cj we lay a 
characteristic strip, which then can be written as x(s,t), y(s,t), 2(s,t), 
p(s,t), q(s,t). To express the parameters s and t in terms of x and y we demand 

that 

A = x^y^ - x^y^ « F^y^ - F^x^ 



f^\ 
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does not vanish identically along the initial strip. Then 2, p and q can be 
expressed in terms of x and y. He only have to make sure that p and q written in 
such a fashion are the partial derivatives of the integral surface z(x,y). Thus 
we have to show that the quantities U and V 

U « z^ - px^ - qy^ 

O-l) 

s ^"s '^^s 



V - 2 - px - qy 



vanish identically. As we have assumed that A ^ we can deduce from O.l) and 



e = z^ ~ z^x^ - 2yy^ 
== ^s ~ ^xXs - Vy 

f'^-^ that 2^ « p and z^ « q. Recall now the characteristic equations! 

dx dy dz 

-- = Fp -- = Fq -- = pFp . qF^ 

ds ds ds 
Using the first two in the last we obtain 

dz dx dy 

— « P-- q-- 

ds ds ds 
which imp I ies V s 0, 

Now to prove U s 0: 

au 

" -^ ^st - Ps^t - P^st - Mt - q^st 0*2> 

8s 

3V 

" = ^9t - Pt**s - P>*st - ^tWs - Wgt (9.3) 

at 

(9.2) - (9.3): 

au av 

/-^ "^ps*^t " pt**s "^ "^syt " ^tys^ ^^'^^ 

ds at 
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Taking into account the characteristic equations and the fact that V b implies 
8V/9t = we can rewrite (9.4) as 

au 

— = p^Fp + q^Fq + x^F^ + y^Fy + (px^ + qy^lF^ 0.5) 

ds 

But we know that the PDE F = 8 holds identically in s and t. Differentiating F 
Mi th respect to t: 

■^ " -^ ' ywt - • z't " • p-'t ' ■ q-- 



Px*<t + ^yt + ''z^t + Vt + ""q^t " *3-^* 



(9.B) in (9.5): 

au 



PzU 



as 

For any fixed t this is an ordinary differential equation for U as a function of 



s wi th the solution: 



s 

/- 



F^ds 



U(8) = U(0)e^ 



As by assumption U(0) is zero, U vanishes everywhere. 

To summarize the previous results: given a curve x(i) , y(t), 2(t) along which 
we also know p(t), q(t) such that 

dz dx dy 
— « p-« 4- q— 
dt dt dt 

F(x{t),y(t),z{t),p(t),q(t)) = and A « Fpy^ - F^x^ ^ 0, then there exists an 
unique integral surface through the initial strip. We get a unique surface 
because the solution of the characteristic equations is uniquely determined by 
its initial values. 

The exceptional case when A = along C^ is analogous to the one discussed in 
the previous section: there are infinitely many integral surfaces through Cj if 
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and only it is a characteristic strip. Again we can say that the characteristic 
curves are branch elements as on either side there can be another member of the 
family of solutions of the PDE while we are assured that along C the first 
derivatives are continuous. 

If Cj^ is only a focal strip along which A = 0, then It might be still 
possible to find an integral surface z through it. But analog to the 
quasi-linear case, z will not have continuous derivatives. 

The last case we will discuss is if C degenerates to a point P with 
coordinates ^xg^yg^Zg). Then the strip condition is identically satisfied for 
all p0 and q^ which also satisfy the PDE, i.e,, for all pg and qg which determine 
the feasible tangent planes in P, Thus we can write pg and qg as functions of a 
parameter t. I f we plug the quantities xg, yg, zg, pgCt), qgft) in the PDE we 
obtain an integral surface which is in this case a conical surface with vertex at 
P* It is called the integral conoid of the partial differential equation at P. 

It can be shown that the solution to the Cauchy problem can also be found by 
constructing the appropriate integral conoids. The integral surface is the 
envelope of the integral conoids whose vertices lie along a given curve C* 



^^^^ 



X, Summary 

In the preceding chapters we dealt with FOPDE's which are continuous and have 
continuous derivatives in all their variables. I4e showed that the problem of 
finding a solution to a given FOPDE is equivalent to solving a system of ordinary 
differential equations. By imposing "sui table" ini tial conditions, a unique 
solution can be found. 

But recall that our motivation for studying FOPDE's was to be able to solve 
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the image irradiance equation: 

R{p,q) « L(x,y) (10.1) 

This equation has two properties which we are going to exploit. First the 
function z does not appear explicitly in the equation and therefore no singular 
integral surface exists. Second the equation can be written as the difference of 
two functions, where one depends only on p and q whereas the other depends solely 
on X and y. Ue will use this fact to deal with discontinuities. 

Let us first review the case when (10,1) is a linear equation (note that 
(10.1) cannot be quasi-l inear ! ) , i.e; 

p i q « L(x,y) 
Ue assume that L(x,y) is continuous and has continuous first derivatives. Let C 
be an initial curve given in parameter form; x = x{t), y » y(t) and z « z(t). 
If the A (as defined in section VIII) does not vanish along C, then we have a 
unique solution. It is continuous and has continuous derivatives if C is a 
continuous di fferent table function of the parameter t. "Any singularities of the 
initial data propagate in the x-y plane along the projection there of the 
relevant characteristic curve [GARG4] . " This is not surprising as characteristic 
curves can be viewed as branch curves in which two integral surfaces meet. Note 
also that higher order derivatives may be discontinuous along characteristic 
curves. 

In the case when C or its projection onto the x~y plane has double points, the 
integral surface has self intersections, i.e. z is not a single-valued function 
of X and y. This is not a case of interest for us, as we can "see" only one value 
of z. Note that a Mobius-strip is not a contradiction to the above assertions, as 
it is not an opaque object. In a case like that of a flobius-str ip mutual 
illumination and shadows are essential for deducing the shape of the object. 

If A vanishes along C, then C is either a characteristic curve and ye get 
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infinitely many solutions or ue get a solution whose derivatives are not 
continuous along C. This second case is of special interest to us. Assume we 
could specify such a C. This would imply that there is for instance an edge Mhich 
«e do not see, as it is neither reflected in the equation itself nor in the 
initial data. But luckily this cannot happen. In the linear case the 
characteristic equations are: 

Xg = 1 and yg "±1 
Thus for A to vanish x^ = y^ which is equivalent to saying that x(t) and y(t) 
have to satisfy the characteristic equations. 

Now we will discuss the general image irradiance equation. Again we will 
assume that RCp.q) and Kx.y) are continuous and have continuous first 
derivatives. In deriving the system of characteristic equations we assumed that 
the integral surface z also has continuous second derivatives [we used this fact 
in equation [5.10] to deduce that Py = q^] . In [MY48. PLI54] it was shown that 
an integral surface can be build from characteristic strips also in the case when 
only the first derivatives are continuous. 

Ue want the integral surface to pass through a curve C again given in 
parameter form by x = x(t), y = y(t) and z = z(t). Then we can determine p(t) 
and q(t) along C by solving the two equations: 

R(p{t).q(t)) = L{x(t),y(t)) (ie.2) 

dz dx dy 

— - p(t)— + q(t)~ (18.3> 

dt dt dt 

which we consider here to be algebraic (not differential) and solved over the 

reals. As (10.2) is nonlinear, we may get zero or several solutions for p(t) and 

q{t). Thus only for a unique determination of the roots of the equations (18.2) 

and (10.3) and the assumption that A ^ along C do we get a unique integral 
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surface. Recall that in the linear case two integral surfaces intersect smoothly 
(i,e, have the same tangent plane along their intersection) only along 
characteristic curves. In the general case this can also happen along the curve 
where the transition from one root of p and q to another takes place^ To 
simplify the following discussion we will assume that p and q are given along C» 
such that equations (10.2) and (10.3) are satisfied. In other word the initial 
data is an initial strip denoted by C^. Again discontinuities in the initial 
data propagate into the solution. It was shown [HA28] » that if the initial data 
does not have continuous second derivatives, then the solution does not have 
continuous first derivatives. To understand this fact, recall the lemma of 
Schwarzs 



Let G be a simply connected region in R*^, fsG -^ R. If f^^, fy and f^y eKist 
and are continuous, then f,,^ exists and f.,,, « f,,^. 

yx; ?^y yA 



Furthermore for p and q to be the partial derivatives of z, they have to satisfy 

the above lemma. Thus if the initial data does not have continuous second 

derivatives, then the lemma of Schwarz is not satisfied along Cp which implies 

that p and/or q are discontinuous. 

The case A = is analogous to the linear case. I f Cj^ i s a charac^ter ist ic 

strip, then we get infinitely many solutions. Again we pose the question whether 

it is possible to specify C-^ such that A « and C| is not character ist!C« Then 

the derivatives of p and/or q would be discontinuous along C (which by the 

preceding remarks implies that the first derivatives are discontinuous)* In that 

case C would be a focal curve, i.e. satisfying the equations 

dx dy dz 

„ « Rp ~» . R^ ~- = pRp + qR^ C10.4) 

dt dt dt 



■>*^ 



r^^. 



Z*'^. 
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but 

dp dq 

- ^ L^(x(t),y(t)) and -- ;^ L (xft) ,y(t)) (10.5) 

dt dt ^ 

This cannot occur as we assumed that the function Kx.y) is continuous and has 
continuous derivatives. Thus if xCt) and y{t) satisfy (18.4) they also have to 
satisfy (18.5) as L^ and Ly depend only on x and y. 

The last case Me have to be concerned is when A vanishes only along parts of 
C [LER57]. But then C cannot be a continuous di f ferentiable function and the 
solution is going to have discontinuous derivatives. 

He always assumed that C is not a closed curve, as this would either 
overdetermine the problem or make it inconsistent. 



XI. Open questions 

Very little i s known about "singular" PDE's. i.e. equations which are not 
continuous in all their variables. Again some literature, e.g. [HAD28r can be 
found about singular second order PDE's. 

In the case of the image irradiance equation we are concerned about 
singularities which occur in the equation itself. We can always assume that 
R(p,q) is continuous in p and q. A case when R(p,q) is not continuous is when the 
surface contains specular i t ies, which can be represented by delta-functions. 
Then a completely different approach has to be taken to solve the equation. But 
in a lot of cases L(x.y) is going to be discontinuous. As an example we use the 
following situation: looking through an electron microscope on a half-sphere 
lying on a flat surface which can be formulated as: 



\y 
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2 2 
2 2 

1 ~ (x^ + y^) 

Along the contour x^ + y^ = 1 the equation is discontinuous. In this case the 
contour is called an occludintj contour. Informally we can say that if LCx^y) is 
discontinuous then the derivatives of the integral surface are going to be 
discontinuous. By specifying the solution along the curve C* Mhere the 
discontinuity occurs; we can still find an integral surface. As z does not 
appear explicitly in the equation, only the projection of C onto the x-y plane 
can be found directly from the equation. Rigorous proofs of these claims are 
going to appear in a subsequent paper. 

He always assumed that the integral surface is continuous. Discontinuities 
in z correspond to gaps and for these kind of situations the image irradiance 
equation is inadequate. 

Another open problem is how to deal with discontinuities in the image 
intensity gradient, i.e. discontinuity in L^ and/or L^. To be able to integrate 
the characteristic equations we had to assume that the first derivatives of L and 
R are continuous. Ue conjecture that the case of discontinuities in the first 
derivatives can be treated in an analogous fashion as the cases of 
discontinuities in the functions themselves. 

The image irradiance equation describes some of the important features of the 
"real" world. There is evidence that human beings deduce a lot of information 
about the shape of an object by looking at its contours and registering the 
"grey" levels. Ue discussed how these two pieces of evidence are tied together 
in a single partial differential equation.. 
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